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ABSTRACT 



A method for determining the optimal or near-optimal 
search path for the wake of a moving target when the search- 
er's motion is constrained is presented. The problem uses a 
Markov motion model in discrete time and space for the 
target and assumes that the searcher is constrained to move 
only from the currently occupied cell j to a specified set 
of "neighbor cells", I (j) . First, a discussion of the 
complexity of the problem is presented. Next, an extension 
of T.J. Stewart's constrained searcher algorithm is given. 
Stewart's algorithm uses S.S. Brown's unconstrained searcher 
algorithm to calculate bounds on the probability cf non- 
detection. An extension of Brown's algorithm to allow the 
use of a wake detector is also given. Several alternatives 
to both algorithms are offered and compared. Finally, some 
further extensions to the algorithms are suggested. 
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I. IN TROD OCTI3N 



A. THE PROBLEM 

The problem considered here is the search for the wake 
cf a moving target in discrete time and space. The target is 
assumed to move through a finite number cf cells according 
to a known Markov process. The goal is to maximize the 

probability of detection by some specified time, t. The 
searcher is assumed to be partially constrained in his 
motion through the search area, being able to move, in one 
time period, from one cell to a limited number of cells in 
close proximity. The searcher is also assumed to have an 'n 
time period wake detector.' The detector is capable cf 
detecting wakes left in a cell by the target up to n ‘■ime 
periods earlier. 

The approach taken to solve the problem was *o extend 
the method of T. J. Stewart, [Ref. 1] and S.S. Srown, 
[Ref. 2]. Stewart addressed searcher employment for three 
cases: where the searcher's effort was infinitely divisible 

among all cells, only partially divisible, or totally indi- 
visible. The three cases correspond to the situation where: 
searcher effort could be divided among ail the possible 
cells during each time period, searcher effort could cover 
some of the cells during each time period, and searcher 
effort could only cover one cell during each time period. 
Stewart presented algorithms for finding optimal or near- 
optimal solutions for the first and third cases and 
suggested possible methods for solving the second case. 
This thesis generalizes the third case to allow for wake 
detection; i.e., the target can be detected at each time 
period in each of several cells through which the target has 
previously passed in the last n time periods. 
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A major difficulty of the algorithms of Stwart and Brown 
is that they are not guaranteed to produce the optimal solu- 
tion for reasons which will be discussed later. This 
failure to always find optimal solutions for the indivisable 
effort case suggests that this problem might be fundamen- 
tally intractable. 

One of the recent advances in computer science is the 
idea of algorithmic complexify and NP- Completeness. 
NP-Completeness refers to the inherent intr actablilitv or 
difficulty of a problem. Generally, NP-Completeness 
describes a set of problems which have been shown tc be 
solvable by an efficient algorithm which is run on a non- 
determinist ic Turing Machine. An efficient algorithm is one 
which will solve a problem in an amount of time proportional 
tc a polynomial function of the length of the input needed 
tc describe the problem. Well-known N?-Complete problems 
include traveling salesman problems, the knapsack problem, 
and integer programming problems. In Appendix 1 a more 
complete discussion is presented of the complexity of the 
search problem forming the basis for this thesis. It is 
suspected (but has not been proved) that this search problem 
is no easier than NP-Complete problems and may be NP-Hard. 
If so, then the investigation of heuristic or approximate 
solution algorithms is warranted. For further information 
on NP-Completeness refer to [Ref. 3]. 
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II. THE A LGORIT HMS USED 



As mentioned earlier, the algorithms used to sciv= the 
search problem were: 1) T.J. Stewart's Constrained Search 
algorithm [Ref. 1], and 2) Brown's Unconstrained Search 

algorithm, [Ref. 2], The Constrained Search Algorithm 
assumes the searcher is constrained in his motion during the 
search, i.e., the searcher can go from his current cell to 
some subset of all the other cells in the grid. The uncon- 
strained searcher algorithm puts no constraints on searcher 
motion but does assume that the first t search cells are 
fixed and tries to optimize the search by choosing the cells 
to search from t+1 to T. Even in the unconstrained problem, 
search is limited to one cell per time period. 

A. STEWART'S ALGORITHM 

1 . Def i ni tion of Sy mbo Is 
J = set of all cells in the probLem 
jeJ = a particular cell 

I(j) = matrix of all cells in J that the searcher can 
reach from cell j (different for each j J) 

j i = the cell to searched at time i 

{jO, jl,. .., jt} = a given search plan 

K(t,jt) = matrix of all cells in J searchable at tim e t+1 
from cell jt that have not yet been considered in candi- 
date search plans 

p = probability of non-detection for the current best 
solution (search plan) 



S t (i) = the nxn search matrix for time period t where 

cell i is the cell to be searched 

1 ] = a column vector of I's 

2 . L ogic 

The following algorithm was taken from [Ref. 1 ] . 

1. Set t =0 , p=1 ; Select a cell to be searched, jO; set 
K (0,10) =1 (jO) . 

2. Solve the substitute problem (discussed below) for 
search over periods t+1, t+2,...,T, with the searcher 
at jt prior to the search, and with searcher location 
in the first period (i.e. t+1) restricted to K(t,jt). 
Obtain thereby (also discussed later) a lower bound p 
on the optimal probability of non- detection when 
searcher paths are restricted to those passing 
through { jO, j 1,.. ., jt} . 

3. If p<p, goto step (6). Otherwise, if is now proved 
that all continuations of the currenr path are non- 
optimal, i.e. the arc from (t— 1 ,jt — 1) to (f,jf) is 
fathomed, goto step (4) . 

4. If t =0, the algorithm terminates (all paths from jO 
are fathomed) ; the current best solution is optimal. 
If t>0, goto step (5). 

5. Delete the current jt from K(t-1,jt-1) and set t=t-1. 
If K (t, jt) is now empty, the arc from (t-1,jt-1) to 
(t,jt) is implicitly also fathomed. Thus return to 
step (4). Otherwise, return to step (2). 

6. select the element of K(t,jt) appearing in the solu- 
tion to the substitute problem and call this jt + 1 ; 
set t=t+1. If t<T, set K(t, jt) =1 ( jt) and return to 
step (2). If t=T, evaluate the probability of non- 
detection when the searcher parh is (10 , j 1 , . . . , j T) . 
If this probability is less than p, then replace p by 
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this value and install { jO, jl . . , jT} as *hs current 
best solution. Return to step (5) . 

Essentially the algorithm solves the partially 
constrained problem (unconstrained after time t+1) at each 
level to obtain a lower bound on the probability of non- 
detection for any fully constrained searchers that have the 
same initial search (jO, . . . , jt + 1} . rhe algorithm then trav- 
erses each branch whose lower bound is less than the current 
best solution probability. When t=r, the search is now fully 
constrained; and , if its probability of non-detection p is 
less than p, then it is a better search plan and is saved. 
When no branches with probabilities less than the current 
best plan are left, the problem is completed and the current 
best plan is optimal. 

Optimality is guaranteed if the lower bounds 
obtained from the application of Brown’s algorithm are 
indeed lower bounds. Unfortunately, due to the nature of the 
problem, (an integer programming problem) the results of 
3rown's algorithm are not necessarily lower bounds. A search 
plan may exist whose ’’lower bound", from Brown’s algorithm 
is higher than the current best solution yet whose actual 
probability of non- detecti on for a fully constrained solu- 
tion is lower than the current best solution. Thus the 
branch containing the optimal solution may be pruned. 
Therefore, the solution produced by Stewart's algorithm 
using Brown’s algorithm as a bound will not necessarily be 
optimal. Nevertheless, the solution might be close enough to 
the optimal for practical problems of interest. 

3 • Alt ern a tiv es 

Stewart's algorithm is essentially a depth- first 
search through a tree of possible solutions. It uses Brown's 
algorithm to bound the branches and remove those branches 
which do not contain better solutions than the current one. 
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The depth-first search strategy generates bounds at. each 
level of the tree and picks the best bound at that level to 
continue the bounding procedure. In this way it reaches a 
fully constrained search in T steps as it progresses down 
through the tree. After reaching the first constrained solu- 
tion the algorithm progresses bare up the tree checking 
other branches on the way up. The algorithm stops when it 
has progressed all the way up to the top of the tree and has 
no bounds which are better then the current best solution. 

Another approach is to use a best-first strategy. In 
this strategy, the best of all the bounds currently calcu- 
lated is chosen as the branch to futher investigate. After 
the new bounds are calculated for the one step investiga- 
tion, the best bound is again chosen to investigate. As the 
best bound is chosen it is checked to see if it meets the 
motion constraints. If the solution does meet the 
constraints then the algorithm stops with the best solution. 
Using the best-first strategy presented by D. R. Smith in 
[Ref. 4], Stewart's algorithm was revised and is presented 
below: 

1. Set t=3, p=1; selecr jO to be the initial search 

cell, sat K (0 , jO) =1 ( jO) . 

2. Solve the substitute problems (discussed earlier) for 
search over periods t+ 1, t + 2, . . . , T , with searcher at 
jt prior to the search, and with searcher location in 
the first period (i. e. t + 1) restricted to K(t,jt). 
Store the lower bound on the optimal probability of 
non-detection for each of the elements of K(t,jt) in 
a priority queue based on the lower bound. (i.e. 
store the search { jo , . . . , jt + 1 } , the length of the 
constrained part of the search, tc=t+1 , and the lower 
bound for each element of K(t,jt)). 

3. Select from the priority queue the search with the 
smallest lower bound and set the current search to 
that chosen search. Set t=tc, set K (t , jt) =1 ( jt) . 
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• Check the current search to see if it meets the move- 
ment constraints (i.e. check for feasibility), if 
feasibLe, then stop, the current search is the best 
search. Otherwise, goto step (2). 

Essentially what the best-first search of the tree 
does is generate bounds for each branch below the root. 
Then it picks the branch with the best bound to continue the 
investigation of the tree. After bounds are generated for 
each branch they are saved on a priority queue from which 
the selection of the best bound is made. A priority queue 
(in the implementation, a priority heap) is used to minimize 
the time and storage requirements necessary to store the 
bounds and find the best bound. Then the algorithm picks 
the branch with the best bound to continue the investigation 
of the tree. Once the best bound is found, it is checked to 
see if it conforms to the movement constraints. If it dees 
conform, the algorithm steps, the optimal solution has been 
found. Otherwise, the branches emanating from the branch 
under investigation are bounded and the algorithm repeats. 

D.P.. Smith, in [Ref. 4], argued that the best-first 
search of most classes of random trees has a strictly 
smaller expected time and space complexity. Therefore, it 
was decided to compare the best-first and depth-first tree 
search algorithms for both use of computer time and opti- 
mality of results. The best-first search, however, is also 
plagued by the possible non -opt imalit y of Brown's alaorithm. 

B. BROWN'S ALGORITHM 

To generate a lower bound on the constrained search 
given that the search during time periods 1,...,t is fixed, 
an algorithm presented by S.S. Brown in [Ref. 2] was used. 

The target position distribution was generated using an 
initial probability density of target location Po and a 
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Markovian motion model. Po, tha target initial distribu- 
tion, is a vector with dimension equal to the number of 
calls in the spatial grid. Markovian motion is described by 
a transition matrix T that contains the probability of 
moving to celL j given that the target was in call i. After 
one time period, the new target location density is Po*T. 

After two time periods it becomes Po»T 2 , and after n moves, 

it becomes Po*Tn. To implement search in the model, a 
search matrix St (i) for time period t was used in the form 
of a diagonal matrix with the ith diagonal element given by 
the probability of a missed detection, and the other diag- 
onal elements equal to unity. Therefore the vector Pc*S1 (1) 
contains the probabilities that the target is in each of the 
cells and remains undetected after a one rime-unit search in 
cell 1. We refer to this vector as "the defective target 
location mass at time period 1". Figure 2.1 illustrates an 
example search problem. Figure 2.2 illustrates a sample 

calculation of Po«S1(1). A four time-unit search in cells 

1, 2, 4, and 3 would yield a defective target location mass, 
Pt(i) given by : 



Pt (i) =P0«S1(1) *r*S2(2) *r«S3 (4) «r*S4 (3) 



( 2 . 1 ) 



The final probability of non-detection pnd for the search is 
given by: 



Pnd=Pt (i) *1] -0.612 



( 2 . 2 ) 



+ - 



Sample 3rid 



1 




2 


3 


I 

1 


4 



The 


target transi 


tion matrix 




.40 .30 .30 


.0 


T = 


.30 .40 .0 


.30 




.30 .0 .40 


.30 




.0 .30 .30 


.40 



The target initial probability distribution 

Po= (0.00 0.00 0.00 1.00) 

The searcher motion constraint matrix 

1 2 3 0 0 

1 2 4 0 0 

1 3 4 0 0 

2 3 4 0 0 

Number of cells is 4 

The probability of non-detection is 0.500 
The initial search cell is 1 

An example Search Matrix for a search in cell 1 

0.50 0.0 0.0 0.0 

Si < 1 ) = 0 . 0 1.00 0.0 0.0 

0.0 0.0 1.00 0.0 

0 . 0 0 . 0 0 . 0 1.00 



Figure 2.1 Example Search Problem. 

1 • D efini t ion of Sy mbo Is 

Sj = The search plan chosen after j iterations of Brown's 
algorithm 

S j (t) = The cell to be searched in time period t in the 

search plan Sj 

Pr.d(Sj) * The final probability of non -detection associ- 
ated with the search plan Sj 
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Po «S 1 (1) = ( . 00 . 00 . 00 


1.00) 


. 5 
0 . 

• 0 . 


0 . 0 . 0 . 

1 . 0 . 0 . 

0 . 1 . 0 . 




= (. 00 . 00 . 00 


1.00) 


0 . 


0 . 0 . 1 . 


J 



Figure 2.2 Sample Calculation of Po«S1(1). 

2 . Logic 

1. Given an initial guess So at a search plan, and given 
a solution tolerance e>0, set t=1, j=1, and Sl=So. 

2. Choose S j (t) to minimize pad (Sj) , (Sj (i) is fixed in 

this minimization for i#t.) The minimization is done 
by calculating Pnd(Sj) for all possible choices of 
Sj(t) and choosing the Sj (t) which has the smallest 
Pnd (Si) . 

3. If t=T, goto step u. otherwise, increment t and goto 
step 2. 

4. If Pnd(S j-1) -Pnd(Si) <e, stop. Pnd(Sj) is "rhe desired 
bound. Otherwise, increment j, set t=1, set Sj=Sj-1, 
and goto step 2. 

Brown's algorithm is an iterative improvement algo- 
rithm, where at each time step t the cell which minimizes 
Pnd is chosen, given that the rest of the search before and 
after t is unchanged. When the Pnd for Sj is within e of the 
Pnd for sj-1, the algorithm is terminated and search Sj is 
used . 

Brownes algorithm in the totally divisible case, 
where at each time period t the solution to the stationary 
search problem is found holding the searches for time 
periods before and after t fixed, will converge to the 
optimal solution as proved in [Ref. 2]. However, because 
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the implementation here only allows search in one cell 
during each time period the solution space becomes discon- 
tinuous and thus non— convex. Therefore, the algorithm is not 

guaranteed to converge to an optimal solution. 

3 • A ltern atives 

Brown's algorithm can be considered to find the 
local optimal solution given a starting solution. So. 

Therefore, the total solution space is partitioned by 

Brown's algorithm into those starting solutions which result 
in the optimal solution (the global optimum) and + hcse 
starting solutions which result in non-optimal solutions 
(local but not global optimums.) Based on this partitioning 
idea several alternatives are available. 

The first is to choose a good starting solution. If 
the optimal solution were used as the starting solution. 
Brown's algorithm would always arrive at the optimal solu- 
tion. However, the optimal solution is not known, otherwise 
Brown's algorithm would be unnecessary. Two approaches were 
used to guess a good starting solution: 1) the myopic solu- 

tion, So (t) is chosen to give the most improvement to 
Pnd(So); and 2) a random solution, a random number generator 
is used to generate random starting solutions. 

As mentioned in [Ref. 2], if a zero solution is used 
to start Brown's algorithm then the myopic solution will 
result after the first iteration. The myopic solution seems 
like a reasonable choice to start the algorithm. On the 
other hand, there might be some negative correlation between 
the optimal solution and the myopic solution, i.e. the 
myopic solution may lie in another partion which does not 
lead to the optimal solution. Therefore the random starting 
solution was also considered as a means to get around any 
possible negative correlation. Since the random solution has 
a finite probability of choosing the optimal solution it may 
have a better chance of starting in the right partition. 
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Another approach used was to restart Brown's algo- 
rithm any time a change was made to the current solution. 
The revised algorithm is presented below: 

1. Given an initial guess so at a search plan set t=1, 
j = 1, and Sl = Sc. 

2. Choose SI (t) to minimize Pnd(Sj) , (SI (i) is fixed in 
this minimization for i*t.) The minimization is done 
by calculating Pnd (SI) for all possible choices of 
SI (t) and choosing the S1(t> which has the smallest 
Pnd (SI) . 

3. If S1(t)*So(t) then set So(t)=Sl(t) and goto step 1. 

4. If t=T, goto step 5. Otherwise, increment t and goto 
step 2. 

5. Stop. Pnd (SI) is the desired bound. 

This variation of Brown's algorithm takes an initial 
solution and starts at the first time period checking for 
local optimality for that time period. If the choice of cell 
to be searched at the current time period is locally optimal 
for that time period then the algorithm goes on to the next 
time period. Otherwise, the algorithm inserts the new search 
cell and starts back at the first time period. When the 
algorithm goes all the way through the solution without 
changes it stops. This approach may repartition the solu- 
tion space increasing the size of the partition which leads 
to the optimal solution. 

Another approach which was not used is to run the 
algorithm several times with different starting solutions 
So. Then the lower bound can be taken as the minimum of the 
locally optimal solutions returned by rhe algorithm. Also, 
the lower bound can be estimated by 



est=(P95*P5-P32.52) / (P95+P5-2-P32.5) . 



(2.3) 
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P5, P95 and P32.5 are the 5TH, 95IH and 32.5TK percentile 

values. This estimate is based on the idea that, as the 
number cf independent solutions produced by a given algo- 
rithm for a given problem increase, the solution values 
converge to a Weibull distribution where the optimal lower 
bound is the location parameter. This approach was not used 
because it required running Brown's algorithm two or more 
times to calculate each bound and it was felt that the addi- 
tional computer time would not improve the bounding process 
significantly. 

A final approach which also was not investigated, is 
to locally optimize the choice of calls over 2, 3 or more 

time periods in the Brown algorithm. This again might 
increase the size of the partition which leads to the 
optimal solution. 
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III. WAKE DETECT I Og 



A. BACKGROUND 

As mentioned earlier, this thesis is an attempt to 
extend existing optimal search theory techniques to the 
problem of wake detection. Steward's and Brown's algo- 
rithms, as presented in the last chapter, indicate one 
method for solving the constrained searcher problem. The 
next question is: "How does one extend the algorithms to 

handle the possibility of wake defection?" 

Stewart's algorithm does no actual calculation of the 
probability of non-detection, it uses Brown's algorithm for 
the calculation of bounds. Therefore Brown’s algorithm is 
the one that needs to be altered to allow for use of a wake 
detector. To extend the algorithm we proceed as follows: 

B. DEFINITION OF SYMBOLS 

Po = initial target probability distribution (i. e. , the 
probability that the target is in any cell i at the start 
of the problem.) 

St (i) = an nxn matrix which reduces the defective prob- 

ability mass of the target by 1-P(d) in cell i searched 
at time i. The defective probability mass of the other 
cells remains unchanged. 

T = a nxn Markov transition matrix which contains the 
probability that a target in cell i at time period t will 
transition to cell j at time period t+1. 

1] = a nxl column vector of 1 ’ s. 



22 



C. LOGIC 



What needs to be extended is the model under which the 
non-detection probability is calculated. As shown earlier, 
this calculation for a non-wake detector in a 4 time unit 
search is 



Pnd=Po *S1 •T*S2*T*S3*T«S4« 1 ]. (3.1) 

It is new proposed to allow the searcher to carry an 
•n-time unit wake detector. 1 This detector has the capa- 
bility of detecting wakes in the cell being searched which 
were made by the target up to n time periods earlier. To 
extend the model to handle ’n-time unit wake detectors' two 
assumptions are made. 

First, it is assumed that each wake search for each time 
period is independent of all other searches. For example, 
whan a searcher searchs cell 2 at time period 3 with a 2 
time unit wake detector he is completing three separate and 
independent searches. The first is of cell 2 looking for the 
wake made by the target during time period 3, the second is 
of cell 2 looking for the wake mads during time period 2, 
and the third is of cell 2 looking for the wake made during 
time period 1. Note the searcher has also completed a 
search during time periods 2 looking for wakes made during 
time periods 1 and 2, and a search during time period 1 
looking for wakes made during time period 1. Therefore, in a 
3 time period search with a two time period detector the 
searcher has made a total of 6 independent searches in 3 
cells, the cells he chose to search at time periods 1, 2, 

and 3 . 

Also note that the target is assumed not to have left a 
wake prior to the start of the problem for ease of computer 



23 



calculation and formulation of the problem. This does net 
restrict the result. 

The second assumption is that wa are trying to calculate 
the probability of non-detaction after the specified length 
of search is completed. ffe are not trying to evaluate the 
probability of non-detection at intermediate points in the 
search. 

Based on those two assumptions, the wake detection 
concept can be considered a simultaneous search of the cell 
the searcher is in now, the cell the searcher will be in 
next time period, the ceil the searcher will be in two time 
periods from now, etc., out to the maximum number of time 
periods the wake is detectable or to the number of time 
periods remaining in the problem, wnichever is smaller. The 
wake search is modeled as if an equivalent search is 
conducted simultaneously with the real-time search, i.e. 
searching for a wake in call j which is t time periods old 
is equivalent to searching in call j , t time periods 

previous, simultaneously with the other searches being 
conducted t time periods previous and waiting t time periods 
to discover the results of the search. 

As shewn previously, the probability of non-detection 
for the search without waka detection can be calculated from 
the product of a series of matricies as shown in equation 
3.1. For a search in the same calls but with a one tim° 

unit wake detactor, the probability of non-detection is 



Pna=Po*S1 •S2*T*S2«S3«T*S3 •S4*T*S4»1 ]. (3.2) 

The vector Po, as defined earlier, is the probability 
that the target is in cell i at the start of the problem. 
The vector Po»Sl is the probability the target was in cell i 
at time period 1 and has not been detected by the wake 
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search conducted during time period 1 looking for a wake 
left in time period 1. The vector Po*S1«S2 is the prob- 
ability the target was in cell i at time period 1 and has 
not been detected by wake searches during rime periods 1 and 
2 looking for wakes created in tine period 1. The vector 
Po*S1*S2*T is then the probability that the target is in 
cell i at tine period 2 an d has not been detected by wake 
searches locking for wakes created during time period 1. 

Following the same line of reasoning, the vector 
Po«S 1 •S2«T*S2«S3 *T*S 3*S4 is the probability that the target 
is in cell i at time period 3 and has not been detected by 
wake searches looking for wakes created during time period 3 
and prior. Of note is the idea that the searcher in effect 
conducts simultaneous searches of 2 cells during a given 
time period but dees not receive the results of the one time 
unit wake search until the next time period. 

The wake detection problem is analagous to the problem 
where a homeowner thinks there are mice in his house and he 
wants to confirm his suspicions. Each room of the house has 
two tape recorders: one which is available for replay of 

what noises were recorded in the previous hour and the other 
which is recording the current hour. The owner can only go 
to adjacent rooms which have doors to the current room. He 
spends one hour in the room of his choice listening for 
mice. Once in a room he can listen for mice and at the same 
time listen to the tape recording of the previous hour. The 
probability of detecting the mice on the tape recorder or by 
listening in a room is the same. The owner now must decide 
how to search the house to maximize his chances of finding 
the mice. 

The tape recordings of the noise in each room are esen- 
tially independent and simultaneous searches of each room in 
the house. The owner can only determine the results of the 
search by tape recorder if he enters the room and listens to 
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the tape recorder. If the owner doesn't listen *o the tape 
recorder daring the hour the second recorder is taping the 
room, the first recorder is rewound and starts taping thus 
destroying the results of that particular search. 

The key assumptions, as stated earlie-r, are that the 
searches are independent and that the goal is to minimize 
the probability of non-detection over a given search length. 
Therefore the matrix multiplication in equation 3.2 is 
valid. For a two time unit detector, th=> probability of 
non- detection is 



Pnd=Po«S1*S2*S3«T*S2*S3*S4*T»S3*S'4 *T*S4* 1 ]. (3.3) 

The matrix multiplication can be extended for a Tl capacity 
wake detector where Tl is the time late a searcher can enter 
a cell and still detect the target's wake. For the Tl 
capacity detector equation 3.2 becomes 



Pnd=Po« ST 1«T« ST2 • T*ST3 «T • ST4 •. ..•3Tmax*1 ]. 
where 



(3.4) 



_ min (Tmax, i+Tl) 

STi = .n. St(j) 



(3.5) 
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IV. RESULTS 



i. DESCRIPTION OP THE COMPUTER PROS RAH 

The algorithms presented in the preceding chapters were 
implemented on the U.S. Naval Postgraduate School's IBM 3033 
computer system in Fortran H (extended) . The program was 
constructed of a main driver program which called various 
subroutines for input, calculation and output. 

The operation of the program can be broken down info two 
main functions: 1) generation of the problem including the 

initial target distribution, the transition matrix and the 
searcher movement constraint matrix; and 2) solution of the 
generated problem. 

The generation of the problem used two methods. In one 
method the problem generated was a deterministic one where 
the target's initial position was at the far corner away 
from the searcher who started in cell 1. The target tran- 
sition matrix was generated assuming that the target had a 
fixed probability of staying in the cell it currently occu- 
pied and the remaining probability of movement was divided 
evenly among the cells which were adjacent. Diagonal move- 
ment was not allowed. Figure 4.1 shows a example initial 
target distribution and target transition matrix for the 
deterministic case. The searcher movement constraint matrix 
was generated by allowing the searcher to move only from the 
current cell to an adjacent cell. 

In the second method, the problem was randomly gener- 
ated. The target was randomly distributed between all the 
cells at the start. The target transition matrix was gener- 
ated assuming a fixed probability of remaining in the 
current cell and then the remaining probability of movement 



27 



Po= (0 


.00 


0 .00 0 


.00 1.00) 




.40 


.30 


.30 .00 


r = 


.30 


.40 


.00 .30 1 




.30 


.00 


.40 .30 




.00 


.40 


.30 .40 

1 


Figure 4.1 Example 


Dete 


r ministically Generated Problem. 


was randomly distributed 


among 


the adjacent cells. The 


searcher movement constr 


a int 


matrix was determined as 



Po= ( 0.23 0.34 0.19 0.24) 





.40 


. 35 


.25 


.00 


T = 


.17 


.40 


. 00 


.43 




.43 


.00 


.40 


.17 




.00 


.25 


.35 


.40 



Figure 4.2 Example Randomly Generated Problem. 

before. Figure 4.2 illustrates a typical random problem. 
Figure 4.3 shows the program structure and subroutines used 
to generate the deterministic and random problems. The 
program requires 6 inputs as defined below: 

1. Size of the grid i. e . 3x3, 4x4, etc. 

2. Probability of detection of the target if the 
searcher and target are in the same cell. Also used 
as the probability of detection of the target using 
the wake detector. 

3. Fixed probability of the target staying in the cell 
it currently occupies, (i.e. Til) 
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Figure 4.3 



Problem Generation Subroutines 



4. Whether the generated problem is to be deterministic 
or random. 

5. Epsilon, used as a stopping criteria for Brown's 
algorithm. 

6. The capability of the wake detector, (i. e. how many 
time units late will the detector detect a wake.) 

Once the problem was generated it was then necessary to 
find the optimal solution using the various algorithms 
mentioned earlier. Seven algorithms were used to find the 
solution: 

1. Depth-First search using the myopic solution to start 
Brown's algorithm. 

2. Depth-First search using a randomly chosen solution 
to start Brown's algorithm. 

3. Depth-First search using a random solution to start 
Brown's algorithm and using the modification which 
restarted Brown's algorithm every time the solution 
was changed. 

4. Best-First search using the myopic solution to start 
Brcwn's algorithm. 

5. Best-First search using a randomly chosen solution to 
start Brown's algorithm. 

6. Best-First search using a random solution to start 
Brown's algorithm and using the modification which 
restarted Brown's algorithm every time the solution 
was changed. 

7. Total enumeration of all possible search solutions to 
determine the one with the lowest probability of 
non-detection . 

The only algorithm guaranteed to produce the optimal 
solution was the total enumeration algorithm which generated 
all possible feasible solutions. Figure 4.4 shows the 
program structure and subroutines necessary to implement the 
algorithms and problem solution part of the program. 
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Figure 4.4 Program Solution Subroutines. 
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The output generated by the program included: 

1. cpu seconds used by each algorithm 

2. number of unconstrained solutions checked 

3. number of constrained solutions checked 

4. probability of detection of the target af^er search 

5. search plan used 

Figure 4.5 presents an example program output. 
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Figure 4.5 Example Program Output. 
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grid sizes of 4 , 



Using the program described above, grid sizes of 4, 9, 

16, and 25 cells were investigated. All seven algorithms 
were tested on deterministic problems with Tmax=2 , . . . , 1 0 and 
Tl=0,1,2. While the problem sizes considered are not large 
enough for real life problems it was felt that they were 
large enough to demonstrate the algorithms. The results can 
then be extrapolated to determine expected running times for 
real life problems. The goal was to answer two questions: 

1. How close to the optimal are the solutions from the 
branch-and-bound algorithms? 

2. How do the running times of the algorithms compare; 
to each other, and to the total enumeration algo- 
rithm? 



B. OPTIMALIT? OP THE ALGORITHM OUTPUT 

As mentioned earlier, the problems under consideration 
ranged from a 4 cell grid with Tmax=2 and Tl=0 to a 25 cell 
grid with Tmax=10 and Tl=2. The total number of possible 
constrained solutions ranged from 3 to 275905. Table I shows 
the number of non-optimal solutions and the maximum percent 
difference between the optimal and non-optimal solutions for 
each of the algorithms. Since the problems were symmetric 

there were several optimal solutions, sc the 

branch-and-bound solution could be an equivalent although 
different solution from the total eameration solution. This 
may have increased the probability of the branch-and-bound 
algorithms finding the optimal solution. Further investiga- 
tion into larger random problems may yield more non-optimal 
solutions and larger percent differences, however, fully 96% 
of Stewart’s results, as reported in [Ref. 1], were optimal 
with the non-optimal results being within .41% of the 
optimal solution. Therefore, the results of this run tend to 
confirm Stewart's results concerning the optimality of the 
branch-and-bound algorithm solutions. 
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TABLE I 

Non-Optimal Solutions 



Algorithms 

1 2 3 4 5 6 

Number 

of N on-optimal 2 0 0 2 1 0 

Solutions 

Maximum percent .0455 055 0 55 . 0455 . 0 1% 055 

Error i 

I 



C. R0H TIME COMPARISON OF THE ALGORITHMS 

Since all the algorithms seem to be able to find the 
optimal or near-optimal solution without too much diffi- 
culty, it is now important to determine which algorithm 
performs the fastest, while the total enumeration algorithm 
was used to provide a benchmark for the optimality of the 
solutions it can also serve as a benchmark for the run-time 
of the algorithms. 

The running time of the total enumeration algorithm is a 

function of the number of possible feasible solutions. The 

number of feasible solutions is based on how many places the 

searcher can go from the cell he currently occupies. From 

each cell the searcher can transition to between 3 and 5 

cells. If the searcher is in a corner cell he can stay where 

he is or transition to either of the two cells which border 

the cell he is in. If the searcher is in a side cell he can 

stay where he is or transition to any of the three border 

calls. If taa searcher is in an interior cell he can again 

stay where he is or transition to any of the four border 

cells. Therefore the total number of feasible solutions is 

Tmax 

bounded below by the exponential function 3 , where Tmax 
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is the length of the search. The number of feasible 

solutions is bounded above by the exponential function 
Tmax 

5 . Since the total enumeration algorithm looks only the 

feasible solutions and calculates Pnd for each one the algo- 

Tmax 

rithm is therefore 0 (e ) or of exponential complexity. 

The branch -and- bound algorithms don’t lend themselves to 
such easy analysis. The worst case analysis would be where 
the bounds are so weak that all the feasible solutions would 
have to be checked. The average case analysis is much more 
difficult. Smith in [Ref. 4], argued that the best-first 
strategy had a smaller average case complexity than the 
depth-first strategy. Since it is unclear whether the trees 
generated by the search problem fit into the class of random 
trees covered by Smith's argument, further complexity anal- 
ysis will not be attempted. 

Appendix 3 contains graphs of the run-time for all seven 
algorithms for all the cases. From the graphs it is clear 
that the best-first strategy did outperform the depth-firs 1 - 
strategy especially as the problem (as measured by the 
number of possible feasible solutions) increased in diffi- 
culty. This is supported by analyzing the number cf solu- 
tions checked by each algorithm. Table II shows the number 
of solutions checked by each algorithm for the 25 cell grid 
with Tl = 2 . 



From table II it appears that until time period 6 the 
algorithms looked at all the possible solutions. Since the 
total enumeration algorithm didn't look at any intermediate 
solutions it was faster. After time period 6 the 
branch-and-bound algorithms where able to use the pruning 
feature to a great extent in removing unpromising branches. 
Table III shows the runtimes needed to used in generating 
the solutions in table II. 3ased on the number of solutions 
calculated by each algorithm it appears that the best-first 
strategy is more efficient. Since the best-first strategy 
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TABLE II 

Nu»ber of solutions for 25 Cell Grid, Tl=2 



Tmax 


PARTIALLY CONSTRAINED SOLUTION 
(Brown's Algorithm Output) 

Algorithm 

1 2 3 4 5 


S 

6 


7 


2 


0 


0 


0 


D 


0 


0 


0 


3 


3 


3 


3 


3 


3 


3 


0 


4 


14 


14 


14 


14 


14 


14 


0 


5 


57 


57 


57 


57 


57 


57 


0 


6 


2 34 


234 


234 


234 


234 


234 


0 


7 


983 


983 


983 


983 


983 


983 


0 


8 


21 16 


2109 


2402 


1 123 


1 123 


1 123 


0 


9 


3988 


4215 


2309 


1573 


1 593 


1 598 


0 


10 


2 7 87 


4066 


4532 


1375 


1359 


1 383 


0 


Totals 


10182 


1 1591 


10 534 


5362 


5366 


5395 


0 


Tmax 


1 


CONST 

2 


RAI NED 
3 


SOLUTIONS 

Algorithm 
4 5 


6 


7 


2 


3 


3 


3 


3 




? 


3 


3 


11 


11 


11 


11 


11 


11 


1 1 


4 


43 


43 


43 


4 3 


43 


43 


43 


5 


177 


177 


177 


177 


177 


177 


177 


6 


749 


749 


749 


749 


749 


74 9 


749 


7 


9 16 


563 


386 


100 


100 


100 


3235 


8 


12 73 


987 


1 439 


0 


0 


0 


14139 


9 


601 


1552 


723 


160 


160 


160 


62309 


10 


2 46 


251 


76 5 


0 


0 


0 


275905 


Totals 


40 19 


4336 


4 296 


1243 


1243 


1 243 


35657 1 






algorithms had almost exactly the same number of solution 
calculations whereas the depth-first strategy algorithms 
were more divergent it could be hypothesied that the best- 
first strategy is more tolerant of the non-optimal bounds 
produced by Brown’s algorithm. 

Table IV shows how the number of solutions varied for 
all the cases where Tmax=10 (i.e. where the maximum number 

of possible feasible solutions was noted.) 
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TABLE III 

Algorithm Runtimes for 25 Call Grid, Tl=2 



Tmax 


1 


2 


3 


Algori 

4 


thm 

5 


6 


7 


2 


0.0 


0.0 


0.0 


0. 0 


0.0 


0.0 


0. 0 


3 


0.2 


0.2 


0. 1 


0. 2 


0.2 


0. 1 


0. 0 


4 


1. 2 


1.2 


0.9 


1.2 


1.2 


0.8 


0. 1 


5 


5.8 


6.6 


4.5 


5. 7 


6.4 


4 . 6 


0. 3 


6 


26. 5 


27.8 


2 1.5 


26.2 


27.3 


22.2 


1.8 


7 


112.3 


1 18.3 


92.6 


105.0 


113.5 


87.8 


9. 3 


8 


331 . 4 


342.6 


344.4 


240. 9 


253.3 


278.9 


48. 2 


9 


821 . 4 


868.2 


794.5 


531.3 


547.5 


74 3.6 


248. 1 


10 


1253. 4 


1500.3 


225 2. 4 


843. 0 


845.0 


1494 . 1 


1249. 1 


Totals 


2552. 2 


2865.2 


351 0.9 


1755. 0 


1 794.4 


2632 . 1 


1556.9 



runtime in cpu seconds 



Table V tabulates the running time required to generate 
the solutions for the cases wher° Tmax=10. From rhe tables 
it can be seen that the best-first strategy dominated the 
depth-first strategy, mainly because it had to look at fewer 
solutions. Also it can be seen that the restart algorithm 
was not competitive when Tmax=10 for any of the cases. This 
reflects the fact that it must restart after every change in 
the current solution and as Tmax increases the number of 
changes also increases. Therefore the restart algorithm is 
forced to restart significantly more frequently and thus 
takes longer to arrive at the local bound. From table IV it 
is seen that the extra time taken to calculate the bound did 
not reduce the number of solutions which were investigated. 

It is apparent that the best-first strategy, using 
either the myopic or random starting solution, performed 
very well when compared to any of the other algorithms. As 
expected, the runtime for the total enumeration algorithm 
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I ABLE 17 

Nuuber of Solutions for Tmax=10, 111 Cases 



PARTIALLY CONSTRAINED SOLUTIONS 
(Brown* s Algorithm Output) 



Grid 

Size 


Tl 


1 


2 


3 


Algorithms 


6 


7 




0 


978 


1092 


10 11 


912 


894 


385 


0 


4 


1 


24 


24 


36 


27 


27 


24 


0 




2 


39 


24 


51 


5 1 


33 


33 


0 




0 


628 


547 


279 


296 


223 


275 


0 


9 


1 


247 


2 19 


213 


121 


81 


30 


0 




2 


270 


163 


306 


136 


151 


14 1 


0 




0 


141 3 


1002 


10 29 


740 


718 


723 


0 


16 


1 


910 


4 19 


419 


332 


409 


400 


0 




2 


347 


891 


380 


320 


339 


373 


0 




0 


4843 


3481 


4013 


1343 


1343 


1343 


0 


25 


1 


33 7 1 


3798 


1266 


1295 


1283 


1313 


0 




2 


2787 


4065 


4532 


1375 


1359 


1383 


0 


Totals 




1 5857 


15665 


13535 


5988 


6860 


5973 


0 


Grid 

Size 


Tl 


TOTALLY 

1 


CONSTRAINED 
2 3 


SOLUTIONS 

Algorithms 

4 5 


6 


7 




0 


198 


390 


375 


189 


195 


195 


19 683 


4 


1 


3 


3 


6 


3 


3 


3 


19633 




2 


3 


3 


6 


3 


3 


3 


19683 




0 


31 


27 


10 


0 


0 


0 


128715 


9 


1 


14 


32 


23 


0 


0 


0 


128715 




2 


63 


5 


53 


45 


54 


8 1 


128715 




0 


272 


1 83 


210 


0 


0 


0 


230 175 


16 


1 


121 


19 


19 


0 


0 


0 


230175 




2 


63 


130 


90 


0 


0 


0 


230 175 




0 


1365 


4 79 


801 


0 


0 


0 


2^5905 


25 


1 


1046 


1240 


10 


0 


0 


0 


275905 




2 


246 


251 


765 


0 


0 


0 


275905 


Totals 




34 25 


2762 


2368 


240 


255 


282 


1963434 



increased rapidly, and it appears, exponentially. The other 
alogorithms, all the depth-first algorithms and the 
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TABLE 7 







Algorithm Runt 


ime for 


Taax = 


10, All 


Cases 




Grid 


Tl 




Algorithms 






Size 




i 


2 


3 


4 


5 


6 


7 




0 


4.3 


4.4 


3.7 


4. 1 


3.9 


3.6 


1 0. 4 


4 


1 


0.4 


0.4 


0.7 


0. 4 


0.4 


0.6 


10. 7 




2 


0.7 


0.4 


1. 1 


0. 9 


0.6 


0.8 


1 0.9 




0 


17.9 


1 6. 1 


1 8. 8 


10. 4 


8.0 


17.6 


150. 8 


9 


1 


14 . 7 


10.6 


1 9.7 


8. 3 


6.9 


15.0 


152. 1 




2 


14. 3 


8.2 


25.3 


10. 9 


9.0 


17.1 


153. 5 




0 


120. 8 


92.1 


19 1.8 


1 13. 1 


101.0 


212.7 


672.9 


16 


1 


174.0 


119.4 


22 1.5 


1 19. 2 


114.9 


220 . 4 


671. 9 




2 


163 . 4 


193.8 


31 8.3 


156. 4 


125.4 


250.2 


674. 8 




0 


661 . 0 


679.2 


1028.6 


561.9 


547.8 


1094.6 


1249. 3 


25 


1 


1 1 24 . 4 


1092.0 


1277.3 


709. 8 


698.9 
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best-first restart algorithm, tends! to be somewhere between 
the two extremes. In the final case, where Tmax=10 and 
Tl=2, the total enumeration algorithm was still competitive. 
It is anticipated that as Tmax is increased beyond 10 the 
total enumeration algorithm will surpass all the other algo- 
rithms in runtime required. 

Based on this example, it appears that the best-first 
strategy with either the myopic or random starting solution 
is preferred. Further examples might indicate a preference 
between the myopic and random starting solutions. 
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V . EXTENSIONS 



A. PD AS A FUNCTION OF WAKE AGE 

The program as currently written, assumes that the prob- 
ability of detection of the wake is constant with the age of 
the wake. In reality, one would expect the probability of 
detection to decrease as the wake age increased. This would 
relatively simple to implement. What would be needed would 
be either a separate probability of detection as the wake 
aged or a functional relationship between wake age and prob- 
ability of detection. The program would then have to be 
modified to use the appropriate probability for the various 
search matricies, St (i) . 

B. COUNTER -DETECT ION 

Another aspect of interest is the idea of counter-detection 
of the searcher by the target. It could be speculated that 
if the target detected the searcher when they were both in 
the same cell at the same time, the search would be blown 
and therefore any target probability mass which detected the 
searcher could be removed from the problem. One way of 
accomplishing this would be to have an added cell to the 
grid. The searcher would be unable to search this cell and 
the target once in the added cell would never transition 
out. Then two search matricies would have to be used. The 
modified search matrix St’ would include a probability of 
counter-detection and a transition of that target prob- 
ability mass which counter-detected into the extra call. 
The search matrix St for the wake search would remain 
unchanged. Figure 5. 1 illustrates the problem input, 
initial probability distribution, target transition matrix, 
and example search matricies. 
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Modified Real-Time Search Matrix 
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Si* (1) = 



Pnd for a 4 time unit Search with a 2 time unit detector 
Pnd=Po*S1'*S2«S3«T*S2**S3«S4*T*S3» •S4*T*S4'«1 ] 



Figure 5.1 Search Problem Modified for Counter-Detection. 
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C- APPROXIMATIONS TO THE OPTIMAL SOLUTION 

For real life problems on the order of 25 x 2 5 grids and 
larger with Tnax>50 and Tl>5, the computer time to reach a 
close approximation of the optimal solution may be exces- 
sive. Therefore, Stewart in [Ref. 1] suggested using the 
first feasible solution that arose from the depth first 
search. The first solution could be viewed as a form of the 
myopic search. The optimality characteristics of such a 
solution have not been subjected to worst case or average 
case analysis. 
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71. conclusion s 



A. PROBLEM COMPLEXITY 

Mention has been made of the apparently fundamental 
intractability of the discrete time and space moving target 
constrained searcher problem. Earlier it was conjectured 
that the problem is at least NP-Complete and possible 
NP-Hard. Appendix A discussed the complexity of the problem 
and provides some justification for the conjecture. 

If the conjecture is true then the implications are 
clear. Conventional attempts at trying to find ’efficient' 
algorithms are doomed to failure, particular ily if the 

problem is NP-Hard. Thus heuristic algorithms are the most 
fruitful avenue for finding optimal or near-optimal 
solutions. 

B*. CHOICE OF AN ALGORITHM 

The myopic starting solution for 3rown's algorithm 
combined with the best-first strategy produces the best 
results. This combination was consistently better than the 
total enumeration algorithm and, as the problem became more 
difficult, performed better than the other five variations. 

The solutions to the constrained searcher problem 
(Stewart's algorithm output) were compared for both opti- 
mality and runtime. However, the solutions to the uncon- 

strained searcher (Brown's algorithm output) were not 
compared except indirectly as the output affected Stewart's 
algorithm. There may be significant differences in the 
bounds provided by the different variations of Brown's algo- 
rithm. It did appear that the restart approach was signifi- 
cantly slower as Tmax increased. This had a significant 
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effect on the performance of Stewart’s algorithm. As Tmax 
increased the restart approach became increasingly slower 
than the myopic or random approaches and the difference 
coaid not be explained by a change in the number of solu- 
tions which had to be calculated. Thus even if the opti- 
mality of the bounds produced by the restart approach was 
improved over the other approaches, if was overshadowed by 
the increased time required. It is conjectured that the same 
effect would occur if the estimation technique were used. 

There are several alternative ways to approach the solu- 
tion of the constrained searcher problem. As shown by 
Stewart in [Ref. 1], the idea of network flows could be 
applied. Also, J.N. Eagle in [Ref. S] proved that a dynamic 
programming approach was guaranteed to provide an optimal 
solution for the ncn-wake search constrained searcher 
problem. Either of the above approaches may be extendable 
to the wake search case. 



C. WAKE SEARCH 



The extension of the constrained searcher problem to 
deal with wakes rested on two assumptions: 1) the indepen- 

dence of the searches and 2) the goal of minimizing the 
probability of non- detectic n for a fixed time period search. 
The first assumption may not in fact be valid under all 
conditions. To say that two searches have independent prob- 
abilities of detecting a target when the searches are 
constrained to use the same search path might be incorrect. 

For example, suppose that at time period i the target 
moved from North to South in cell j. Also suppose that in 
time period i+2 the target moved from East to West in the 
same cell j. Now the searcher enters the cell at time 
period i + 4 with a 5 time unit wake detector. If the searcher 
uses a search plan that searches from East to West in an 
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exhaustive fashion he has several chances and thus a higher 
probability of detecting the tine period i wake than the 
time i+2 wake. Ccnversly if the searcher uses an exhaustive 
search path from North to South he will have several chances 
to detect the wake from time period i+2. Therefore it may be 
an oversimplification to assume that the wake searches are 
all independent of each other. The assumption did make the 
calculations possible and therefore even if the assumptions 
stretches the truth it will still yield answers cf interest. 
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APPENDIX A 

DISCUSSION OF THE COMPLEXITY OP THE SEARCH PROBLEM 

In this appendix, I hope to lay the foundation for the 
determination of the complexity of the wake search problem. 
The problem will be approached in rwo ways: 

1. Show a restricted version of the constrained wake 
search problem is an element of NP. 

2. Show that the unconstrained wake search problem is 
functionally similar to the Knapsack Problem which 
has been shown to be NP-Complete. 

As defined in [Ref. 3], a problem is in NP if a tenta- 
tive solution can be written down and checked in time poly- 
nomial in the size of the problem input. The wake search 
problem can be formulated as follows: 

INPUT: A finite set J= (jl , j2,. . . , jn} of cells which can 

be searched, a probability P0= {pi , d 2 , . . . ,pn} , 3<pi<1 for all 

i= 1 , N that the target will start the problem in each cell, a 

probability Tij, 0<Tij<1 for all i =1 , N, j=1,N that the 

target will move from cell i to cell j, a bound B>0, and the 

sets I(ji) for each ji, a subset of J containing the cells 
reachable from cell ji in the next time period. 

QUESTION: Is there a "search" of the cells in J of 

length T having a total probability of non-detection no more 
than B such that each jt+1 is an element of I (jt) ? The prob- 
ability of non- detec tion is 



Pnd=Po «ST 1«T»ST2*T«ST3*T*. .. •STmax*1] (A. 1) 

Given the above problem definition, what non- 
determinist ic algorithm will solve it in polynomial time? A 
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non- deterministic algorithm is one which contains two 
stages; a guessing stage which simply guesses an arbitrary 
search j1,j2,...,jr and a polynomial time "checker" which 
answers the question, "does the arbitrary search have a 
non-detection probability less than B?" It will suffice to 
show that the "checker" will stop in polynomial time and 
answer the guastion, yes or no. 

The "checker" merely calculates the probability of r.cn- 
dstection using equation A. 1 and compares the result with 3. 
The calculation entails ( T— 1 ) + (T*rl) >1 matrix multiplica- 
tions each of which requires NxN multiplications. Therefore, 
the calculation will require 0(T«ri*N 2 ) time to complete. 
The input to the problem has length 0 (N 2 +log (T) +log (Tl) ) (N 
elements of PO, N 2 elements of Tij, at most N 2 elements of 
I(ji) , N elements of the guessed search and the values of T 
and Tl.) If T and Tl are restricted to be less ■ fc han or 
equal to some specified polynomial function of N, ? (N) , then 
the input becomes 0(P(N)«N 2 ) and the calculation time 
becomes 0(P(N) 2 «N 2 ), both of which are polynomial in N. 
Therefore the "checker" will answer the question in polyno-' 
mial time based on the length of the input. Based on the 
above, the wake search problem is in NP. If the restriction 
on the size of T and Tl are removed the problem may not be 
in NP, i.e. the problem may be NP-Hard. 

Once it has been shown that a given problem is in NP, if 
is of interest to see if the problem belongs to the class of 
problems called NP-Ccmplete. This class of problems is known 
to be the set of the hardest problems in NP. It is conjec- 
tured that the wake search problem as described above is no 
easier than the NP-Complete problems, however, a proof is 
not available. Following is a partial justification for the 
conjecture. 

Proof that a problem is NP-Complete can be done by 
showing equivalence between the given problem and a problem 



47 



already shown to be NP-Complete. As shown above, a 

restricted version of the wake search problem is in NP. Now 
if it could be shown that the wake search problem is no 
easier than a problem which is NP-Completa the proof would 
be done. What will be done is to show that a relaxed version 
of the wake search problem namely the wake search problem 
where the searcher motion is unconstrained is functionally 
similar to the knapsack problem which is NP-Complete. 

The knapsack problem can be stated as follows: 

GIVEN: Finite set U, for each u U a size s(u) Z+ and a 

value v(u) Z+, and positive integers B and K. 

QUESTION: Is there a subset U' of U such *hat 

1 s(u)<B and such that 1 v(ui>K? 
ueU * ueU' 

The unconstrained searcher problem can be stated as 

follows : 

GIVEN: a finite set JxTmax, a finite set T, a finite set 
Po, for each jt JT a size s(ji)=1 and a value v(ji)=Pnd, and 
a positive integer Tmax and a rational number K<1. 

QUESTION: Is there a search J= { j 1 . . , jTm ax} a subset of 

JxTmax, such that each element ji of J is an element of the 

disjoint subset JI where the subsets JI form a partition of 

Tmax 

JxTmax and such that Z s(ji)=Tmax and such that equation 

i=1 

A. 1 <K? 

While there appears to be significant differences 
between the wake search problem and the knapsack problem, 
there is enough similarity that the conjecture that the wake 
search problem is at least as hard as the knapsack problem 
is reasonably justified. Since the wake search problem as 
compared to the knapsack problem is the unconstrained 
version it also appears that the constrained wake search is 
also at least as hard. 

It has been shown that a restricted version of the 
constrained wake search problem is in NP. It can be hypoth- 
esized that if the restriction (that I and II be polynomial 
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functions of N) wees removed the problem would not be in NP. 
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APPENDIX B 

GRAPHICAL COMPARISON OF ALGORITHM RUNTIMES 

This appendix contains graphs of the runtimes of the 
algorithms for the following cases: 
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Each graph contains the runtimes for each of the seven algo- 
rithms, with the following symbols representing each algo- 
rithm : 

* - Depth-First Strategy, myopic starting solution 

* - Depth-First Strategy, random starting solution 

+ - Depth-First Strategy, restart algorithm 

x - Best-First Strategy, myopic starting solution 

V - Best-First Strategy, random starting solution 

A - 3est-First Strategy, restart algorithm 

o - Total Enumeration 
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Figure B.4 9 Cell Grid, Tl=0, and Tmax=1,10. 
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Figure B.7 16 Call Grid, Tl=0, and Taar=1,10. 
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Figure B.10 25 Cell Grid, 11=0, and Tmax=1,10. 
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Figure B.12 25 Cell Grid, 11=2, and Tmax=1,10. 
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